Goto

Collaborating Authors

 scale space


Learning Images Across Scales Using Adversarial Training

Wolski, Krzysztof, Djeacoumar, Adarsh, Javanmardi, Alireza, Seidel, Hans-Peter, Theobalt, Christian, Cordonnier, Guillaume, Myszkowski, Karol, Drettakis, George, Pan, Xingang, Leimkühler, Thomas

arXiv.org Artificial Intelligence

The real world exhibits rich structure and detail across many scales of observation. It is difficult, however, to capture and represent a broad spectrum of scales using ordinary images. We devise a novel paradigm for learning a representation that captures an orders-of-magnitude variety of scales from an unstructured collection of ordinary images. We treat this collection as a distribution of scale-space slices to be learned using adversarial training, and additionally enforce coherency across slices. Our approach relies on a multiscale generator with carefully injected procedural frequency content, which allows to interactively explore the emerging continuous scale space. Training across vastly different scales poses challenges regarding stability, which we tackle using a supervision scheme that involves careful sampling of scales. We show that our generator can be used as a multiscale generative model, and for reconstructions of scale spaces from unstructured patches. Significantly outperforming the state of the art, we demonstrate zoom-in factors of up to 256x at high quality and scale consistency.


Neural Gaussian Scale-Space Fields

Mujkanovic, Felix, Nsampi, Ntumba Elie, Theobalt, Christian, Seidel, Hans-Peter, Leimkühler, Thomas

arXiv.org Artificial Intelligence

Gaussian scale spaces are a cornerstone of signal representation and processing, with applications in filtering, multiscale analysis, anti-aliasing, and many more. However, obtaining such a scale space is costly and cumbersome, in particular for continuous representations such as neural fields. We present an efficient and lightweight method to learn the fully continuous, anisotropic Gaussian scale space of an arbitrary signal. Based on Fourier feature modulation and Lipschitz bounding, our approach is trained self-supervised, i.e., training does not require any manual filtering. Our neural Gaussian scale-space fields faithfully capture multiscale representations across a broad range of modalities, and support a diverse set of applications. These include images, geometry, light-stage data, texture anti-aliasing, and multiscale optimization.


Scale Adaptive Blind Deblurring

Neural Information Processing Systems

The presence of noise and small scale structures usually leads to large kernel estimation errors in blind image deblurring empirically, if not a total failure. We present a scale space perspective on blind deblurring algorithms, and introduce a cascaded scale space formulation for blind deblurring. This new formulation suggests a natural approach robust to noise and small scale structures through tying the estimation across multiple scales and balancing the contributions of different scales automatically by learning from data. The proposed formulation also allows to handle non-uniform blur with a straightforward extension. Experiments are conducted on both benchmark dataset and real-world images to validate the effectiveness of the proposed method. One surprising finding based on our approach is that blur kernel estimation is not necessarily best at the finest scale.


@Radiology_AI

#artificialintelligence

Once again, we see how radiology and chest imaging can benefit from image analysis methods that originated in other fields after they are translated by a capable group of experts who develop and test new tools that advance chest image analysis. In addition, we see the vocabulary of radiology expands to incorporate novel concepts from medical image analysis, such as isophotes, scale space, and invariants, that enrich our clinical literature. Author declared no funding for this work.


NOTES2: Networks-of-Traces for Epidemic Spread Simulations

Liu, Sicong (Arizona State University) | Garg, Yash (Arizona State University) | Candan, K. Selcuk (Arizona State University) | Sapino, Maria Luisa (University of Torino) | Chowell-Puente, Gerardo (Arizona State University)

AAAI Conferences

Decision making and intervention against infectious diseases require analysis of large volumes of data, including demographic data, contact networks, age-specific contact rates, mobility networks, and healthcare and control intervention data and models. In this paper, we present our Networks-Of-Traces for Epidemic Spread Simulations (NOTES2) model and system which aim at assisting experts and helping them explore existing simulation trace data sets. NOTES2 supports analysis and indexing of simulation data sets as well as parameter and feature analysis, including identification of unknown dependencies across the input parameters and output variables spanning the different layers of the observation and simulation data.


Scale Adaptive Blind Deblurring

Zhang, Haichao, Yang, Jianchao

Neural Information Processing Systems

The presence of noise and small scale structures usually leads to large kernel estimation errors in blind image deblurring empirically, if not a total failure. We present a scale space perspective on blind deblurring algorithms, and introduce a cascaded scale space formulation for blind deblurring. This new formulation suggests a natural approach robust to noise and small scale structures through tying the estimation across multiple scales and balancing the contributions of different scales automatically by learning from data. The proposed formulation also allows to handle non-uniform blur with a straightforward extension. Experiments are conducted on both benchmark dataset and real-world images to validate the effectiveness of the proposed method. One surprising finding based on our approach is that blur kernel estimation is not necessarily best at the finest scale.


Scale space filtering

Witkin, A. P.

Classics

An initial description ought to be as compact as possible, and its elements should correspond as closely as possible to meaningful objects or events in the signal-forming process. Frequently, local extrema in the signal and its derivatives-- and intervals bounded by extrema--are particularly appropriate descriptive primitives: although local and closely tied to the signal data, these events often have direct semantic interpretations, e.g. as edges in images. A description that characterizes a signal by its extrema and those of its first few derivatives is a qualitative description of exactly the kind we were taught to use in elementary calculus to "sketch" a function. A great deal of effort has been expended to obtain this kind of primitive qualitative description (for overviews of this literature, see [1,2,3].) and the problem has proved extremely difficult. The problem of scale has emerged consistently as a fundamental source of difficulty, because the events we perceive and find meaningful vary enormously in size and extent. The problem is not so much to eliminate fine-scale noise, as to separate events at different scales arising from distinct physical processes.[4]